Skip to content

Integrate LibTorch into ChAI#65

Merged
Iainmon merged 52 commits into
mainfrom
im-dev
Apr 19, 2025
Merged

Integrate LibTorch into ChAI#65
Iainmon merged 52 commits into
mainfrom
im-dev

Conversation

@Iainmon
Copy link
Copy Markdown
Owner

@Iainmon Iainmon commented Mar 26, 2025 •
edited
Loading

  • Create CMake build system for ChAI.
  • Allow PyTorch and Chapel/ChAI compatability
  • Add Bridge library system to handle LibTorch memory allocation and communication
  • Give convolution and other operations a mega performance increase
  • Add lots of functionality to ndarray
  • Support loading .pt PyTorch tensor files
  • Support running PyTorch models via ChAI
  • Improve VGG example and simplicity (not usable right now)
  • Pave way for others to implement operations that use LibTorch

Iainmon added 30 commits March 26, 2025 07:06
@Iainmon
Merge branch 'main' into im-dev
734782c
@Iainmon
Merge branch 'main' into im-dev
edd77d7
@Iainmon
Test
474d18d
@Iainmon
Add good makefile example in clib folder.
ac5a2f3
@Iainmon
Add initial code for TorchBridge.
d3c07f8
@Iainmon
Linking to pytorch works, but there are C++ runtime errors in certain…
42fa424 
… basic functions. See ./Bridge
@Iainmon
Working on linking all of pytorch as a static lib.
0afe591
@Iainmon
Add pytorch.
c8ca2b9
@Iainmon
Remove pytorch submodule.
f94d02a
@Iainmon
Add change to bridge cmake file. Need help from Chapel team.
0f7a6a6
@Iainmon
Change CXX version in CMAKE.
d65f528
@Iainmon
Add makefile to bridge folder. Working now.
a585c5c
@Iainmon
Bridge module is working.
a7d5ad3
@Iainmon
Communication with libtorch now only uses tensor_result_t.
62f0a59
@Iainmon
Change tensor_result_t to bridge_tensor_t.
7d36321
@Iainmon
Made example method for passing data to and from libtorch.
5594567
@Iainmon
Improve chapel/pytorch interop with unsafe pointers.
f68e3c0
@Iainmon
New makefile working for bridge. Going to look into CMake for entire …
81fa1f2 
…project.
@Iainmon
Make working CMake file for torchbridge
b21b993
@Iainmon
Remove build folder.
817887f
@Iainmon
Add build dir to gitignore.
9d0de35
@Iainmon
Remove error cmake file.
df78e35
@Iainmon
Add dependency for Bridge.
3231eb3
@Iainmon
Add installation version for libtorch.
7f26b95
@Iainmon
Remove comments in CMakeLists.
418a2c7
@Iainmon
Compiling with all pytorch shared libs works for mac.
f00e90a
@Iainmon
Compiling with all pytorch shared libs DOES NOT work for mac.
4ff027d
@Iainmon
Add linker args for more torch libs
7b5b696 
.
@Iainmon
Add linker args for more torch libs
085fd9b 
.
@Iainmon
Add tiny test to cmake file.
6a8fffa
Iainmon added 16 commits April 12, 2025 00:40
@Iainmon
Working with tensor handles in test file. Going to try using owned.
889c69b
@Iainmon
Tensor Handle allocator working better.
9cde086
@Iainmon
Improved CMake config.
8bfcc77
@Iainmon
VGG can compile with libtorch.
a534ee8
@Iainmon
VGG example working well. see bottom of cmake file.
43a96f8
@Iainmon
VGG example working well with new maxpool code.
333e829
@Iainmon
Rolled back static pytorch building.
f0ab1c1
@Iainmon
Improve cmake config and add vgg to it.
d5f44de
@Iainmon
Improve speed of vgg model example by adding parallel model chunk loa…
9b3c674 
…ding.
@Iainmon
Remove debug prints in model loading code.
20cc949
@Iainmon
Improve VGG example with cmake.
ca79bbe
@Iainmon
Improve vgg model build experience. See end of CMakeList.txt.
f5efcae
@Iainmon
Improve vgg code. Going to add pytorch tensor file loading.
34d4447
@Iainmon
Add pytorch file format loading functionality for ndarrays.
5aba91a
@Iainmon
Improve something.
0b180cd
@Iainmon
Add incredible improvements to vgg and vridge.
b5060e9
@Iainmon Iainmon changed the title Im dev Integrate libtorch into ChAI Apr 17, 2025
@Iainmon Iainmon changed the title Integrate libtorch into ChAI Integrate LibTorch into ChAI Apr 19, 2025
@Iainmon
Copy link
Copy Markdown
Owner Author

Iainmon commented Apr 19, 2025

Integrate LibTorch into ChAI. Merge needed for OSU capstone team members.

@Iainmon Iainmon merged commit 0b1c8b8 into main Apr 19, 2025
2 of 3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@Iainmon